Sparse Multi-Output Radial Basis Function Network Construction Using Combined Locally Regularized Orthogonal Least Square and D-Optimality Experimental Design

A new construction algorithm for multi-output radial basis function (RBF) network modelling is introduce by combining a locally regularized orthogonal least squares (LROLS) model selection with a D-optimality experimental design. The proposed algorithm aims to achieve maximized model robustness and sparsity via two effective and complementary approaches. The LROLS method alone is capable of producing a very parsimonious RBF network model with excellent generalization performance. The D-optimality design criterion further enhances the model efficiency and robustness. A further advantage of the combined approach is that the user only needs to specify a weighting for the D-optimality cost in the combined RBF model selecting criterion and the entire model construction procedure becomes automatic. The value of this weighting does not influence the model selection procedure critically and it can be chosen with ease from a wide range of values.